Estimation Bias in Maximum Entropy Models
نویسندگان
چکیده
منابع مشابه
Estimation Bias in Maximum Entropy Models
Maximum entropy models have become popular statistical models in neuroscience and other areas in biology and can be useful tools for obtaining estimates of mutual information in biological systems. However, maximum entropy models fit to small data sets can be subject to sampling bias; i.e., the true entropy of the data can be severely underestimated. Here, we study the sampling properties of es...
متن کاملOn Tsallis Entropy Bias and Generalized Maximum Entropy Models
In density estimation task, maximum entropy model (Maxent) can effectively use reliable prior information via certain constraints, i.e., linear constraints without empirical parameters. However, reliable prior information is often insufficient, and the selection of uncertain constraints becomes necessary but poses considerable implementation complexity. Improper setting of uncertain constraints...
متن کاملCorrecting sample selection bias in maximum entropy density estimation
We study the problem of maximum entropy density estimation in the presence of known sample selection bias. We propose three bias correction approaches. The first one takes advantage of unbiased sufficient statistics which can be obtained from biased samples. The second one estimates the biased distribution and then factors the bias out. The third one approximates the second by only using sample...
متن کاملBias Analysis in Entropy Estimation
We consider the problem of finite sample corrections for entropy estimation. New estimates of the Shannon entropy are proposed and their systematic error (the bias) is computed analytically. We find that our results cover correction formulas of current entropy estimates recently discussed in literature. The trade-off between bias reduction and the increase of the corresponding statistical error...
متن کاملMaximum entropy estimation in economic models with linear inequality restrictions
In this paper, we use maximum entropy to estimate the parameters in an economic model. We demonstrate the use of the generalized maximum entropy (GME) estimator, describe how to specify the GME parameter support matrix, and examine the sensitivity of GME estimates to the parameter and error bounds. We impose binding inequality restrictions through the GME parameter support matrix and develop a ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Entropy
سال: 2013
ISSN: 1099-4300
DOI: 10.3390/e15083109